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INTRODUCTION 

The recent special report, “Indiana’s Vision 
of Response to Intervention” issued by the 
Center for Evaluation & Education Policy 
(CEEP) was the first of a three-part series 
aimed to build a fundamental understanding 
of a Response-to-Intervention (RTI) frame- 
work in Indiana’s schools to aid in the pre- 
vention and intervention of both academic 
and behavioral problems for all students. The 
report also discussed the impetus for imple- 
mentation of RTI, as well as what the state of 
Indiana is currently doing to respond to and 
guide schools through this new initiative. 
Specifically, Indiana’s Department of Educa- 
tion (IDOE) has developed a framework of 
RTI that addresses six core components on 
which to focus: (1) evidence-based curricu- 
lum, instruction, intervention and extension; 
(2) assessment and progress monitoring; (3) 
data-based decision making; (4) leadership; 
(5) family, school, and community partner- 
ships; and (6) cultural responsivity. 

According to a statewide RTI survey of Indi- 
ana educators administered by CEEP in Janu- 
ary of 2009, 85.2% of respondents indicated 
that their school is either conceptualizing 
their RTI framework or in the initial stage of 
implementation. Thus, the current report 
examines in greater depth the first three core 
components of the RTI framework to support 
schools in their implementation and under- 
standing of: evidence-based core curriculum, 
instruction, intervention and extension; 
assessment and progress monitoring; and 
data-based decision making. 



EVIDENCE-BASED CORE 
CURRICULUM, INSTRUCTION, 
INTERVENTION, AND EXTENSION 



What is Evidence-based 
Curriculum, Instruction, 
Intervention, and Extension? 

Evidence-based curriculum refers to the 
materials and practices that have been sup- 
ported by research as the most effective and 
beneficial in helping students learn. RTI has 
been termed a “multi-tiered service-delivery 
model,” with the first tier usually consisting 
of the core curriculum that is aligned with 
state standards. Universal screening is admin- 
istered to all students to determine whether 
the current core curriculum is appropriate. 
Those students that are found to be “nonre- 
sponsive” (i.e., when their data do not meet 
the norm benchmark) are provided with sup- 
port in Tier 2. Students whose scores far sur- 
pass the benchmark may also be supported by 
Tier 2 interventions (i.e., extensions). Using 
curricula, interventions, and extensions that 
are empirically supported is necessary to 
ensure that students are provided with the 
best available practices. Otherwise, it is diffi- 
cult to judge whether a student is nonrespon- 
sive because he or she is having difficulties, 
or because there is a problem with the core 
curriculum. This distinction is important as 
each problem requires a different solution. 
The use of scientifically-based programs and 
practices helps to ensure that student difficul- 
ties are not due to inappropriate or ineffective 
classroom instruction. Furthermore, the No 
Child Left Behind Act of 2001 (P.L. 107-110) 
(NCLB) requires that practitioners use “sci- 
entifically-based research.” Therefore, the 
use of evidence-based research is not only 
legally mandated, but there is a clear need for 
these practices to be implemented within 
school systems to appropriately judge student 




performance. To determine if a school is uti- 
lizing scientific research-based core curricu- 
lum programs, the What Works 
Clearinghouse (see Web Resources for link) 
has compiled a list of core programs to assist 
schools in choosing what is most effective. 
Programs are rated based on the number of 
studies conducted on a particular program, 
the sample size used, and the extent of evi- 
dence supporting the program. 

Within all RTI approaches, tiered instruction 
and intervention are seen as essential pieces. 
First and foremost, evidence-based instruc- 
tion of the core curriculum is important 
because all students receive this, regardless 
of the type of services they receive within the 
RTI framework. Shapiro (2008) explains, 
“although the assessment components of RTI 
(universal screening and progress monitor- 
ing) are essential elements of implementa- 
tion, it is the instruction that occurs as a 
function of the outcomes of the assessments 
that truly drives the changes we hope to see in 
students who are identified as being at some 
level of risk for not meeting academic expec- 
tations.” This also goes for the behavioral 
application of RTI. Similar to RTI approaches 
for academics, the first tier of support in using 
RTI for behavior concerns addresses all stu- 
dents via the development of school-wide 
expectation and instruction. In other words, 
school rules, routines, and physical arrange- 
ments are created and identified (via a matrix 
graph), and taught (using observations and 
reinforcements such as praise and tangible 
rewards) by school personnel to prevent ini- 
tial occurrences of maladaptive behavior the 
school would like to target for change (Sugai 
et al., 2005). 

Indiana’s Vision of RTI, a guidance docu- 
ment created by the Indiana Department of 
Education, states that although there is no one 
universal model of RTI, a meta-analysis of 
the seven prevalent models supports a three- 
to five-tier version, which allows the inten- 
sity of instruction (both academic and behav- 
ioral) to be adjusted to meet diverse student 
needs (Indiana Department of Education, 
2009). Through Tier 1 service delivery, 
approximately 80% of students are expected 
to reach levels of competency in the content 
area assessed. Those who do not meet the 
benchmark may require supplemental sup- 
port through Tier 2 service delivery, where 
students engage in instructional programs 
that are catered to their individual needs in 
small groups (about 5 to 8 students). Some 
models have one-on-one individual support 
for students in Tier 3, while other models use 
smaller group instruction (about 3-5 stu- 
dents). Within this model differentiated 



instruction is important in order to meet the 
needs of all students, no matter their instruc- 
tional level (Johnson et al., 2006). While tiers 
may be composed differently, in general, a 
higher degree of specificity and intensity is 
associated with a higher tier of intervention. 
For example, Tier 2 instruction may utilize 
small-group instruction while Tier 3 instruc- 
tion may be more catered towards the indi- 
vidual student. Students who are not 
responsive to Tier 3 interventions may be 
considered for identification as having a spe- 
cific learning disability. 

In the common three-tier approach to RTI, 
primary supports and interventions comprise 
the “least-intensive” level of service delivery 
(also known as Tier 1 interventions, see Fig- 
ure 1). This first tier aligns with what the 
NCLB considered as high-quality instruction. 
Tier 1 is designed to help all students in the 
school with well- supported, research-based 
instructional programs. Interventions at this 
level are intended to be proactive and preven- 
tive. Having a strong core curriculum, 
instruction, and school organization as part of 
one’s Tier 1 increases the likelihood of 
achievement and success for all students. 
This can reduce the number of students who 
are struggling or may be referred for special 
education services by providing a learning 
experience that should be beneficial to most 
students. The Individuals with Disabilities 
Education Improvement Act of 2004 (RL. 
108-446) (IDEA, 2004) states that students 
must receive appropriate learning experi- 
ences before a disability can be considered as 
the basis for achievement or behavioral diffi- 
culties. In Tier 1 general education teachers 
adopt scientific, research-based instructional 
programs in core areas such as reading, writ- 



ing, and math. Additionally, to address 
behavior concerns, schools may adopt a 
school-wide system of behavioral supports 
(Tier 1). It is important that the programs are 
implemented in the manner that they were 
designed, with ongoing measures of imple- 
mentation fidelity used. In this first tier gen- 
eral educators are expected to participate in 
regular and rigorous professional develop- 
ment to continuously build their professional 
competencies. 

Certain key features of RTI translate across 
disciplines to foster student growth. For 
example, Al Otaiba, Kosanovich-Grek, 
Torgesen, Hassler, and Wahl (2005) reference 
three key features for effective core programs 
that are applicable across disciplines includ- 
ing: (1) a clearly articulated statement of sci- 
entifically based research; (2) explicit 
instructional strategies; and (3) consistent 
organizational and instructional routines. 
Although the RTI framework can be used for 
writing, mathematics, science, social studies, 
and reading, the vast majority of research 
thus far has focused primarily on reading (in 
the academic application of RTI). Pertaining 
specifically to the research on reading, 
including these three components in a core 
reading curriculum may help prevent stu- 
dents’ reading difficulties. Further, the Ore- 
gon Center’s Consumer’s Guide recommends 
that educators select a core reading program 
by taking into consideration the demographic 
characteristics of the students who will use 
the program and whether the program is effi- 
cacious (as supported by robust experimental 
studies). In addition, the guide provides a 
critical elements analysis in order to assist 
educators in determining whether the five 
major components of reading instruction 



Figure 1. Example of a Three-Tier Framework of RTI 




Source: Indiana Department of Education (2009). Indiana's Vision of Response to Intervention: Using 
Response to Intervention (RTI) for Indiana's Students. 
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emphasized by the national reading panel 
(phonemic awareness, phonics, fluency, 
vocabulary, and reading comprehension) are 
addressed. 

As mentioned in the first report of this series, 
Hughes and Dexter (2006) found in their 
review of published articles regarding the 
effectiveness of various RTI models (field 
studies) that, despite differing models and 
frameworks of RTI, all of the 1 1 field studies 
on academic performance found some level 
of student performance or achievement 
improvement. This finding suggests that 
tiered intervention programs may aid stu- 
dents’ academic performance (although there 
is a need for more sound research procedures 
and designs to be used in these field studies to 
control for outside variables that may be 
associated with improvement in student aca- 
demic performance). 

There is a wealth of information on the behav- 
ioral application of RTI as well. Homer (2008) 
describes the link between literacy supports 
and behavior, stating that students who strug- 
gle academically are likely to not only find 
academic work aversive, but also find escape- 
maintained problem behaviors reinforcing. 
Thus there is a clear need to address behavior 
concerns in order to improve students’ aca- 
demic performance, and vice versa. In fact, an 
elementary school teacher, during one of the 
12 site visits that the authors conducted to 
examine local implementation of RTI in Indi- 
ana schools, shared, “It’s not just academics 
that RTI focuses on. That’s another mindset 
that we're run into. I think that’s going to be 
one of the big things in the middle school and 
the high school — is that they don’t realize that 
it’s not just reading and writing and arith- 
metic. There is more to that. Other compo- 
nents in their life might be affecting how 
they're learning to read and write.” 

As also mentioned in the first special report, 
school-wide Positive Behavior Support 
(PBS), a three-tiered continuum of service 
delivery implemented in classroom and non- 
classroom settings, provides students with a 
variety of strategies to help them achieve 
social and learning goals while preventing 
problem behaviors (Office of Special Educa- 
tion Programs [OSEP] Technical Assistance 
Center on Positive Behavioral Interventions 
& Supports [PBIS], n.d.). In Tier 1 (primary 
prevention), school- wide expectations are 
established, and universal screening is used to 
identify students at risk of developing social, 
emotional, or behavioral problems (Bums, 
Deno, & Jimerson, 2007; Sugai et al., 2005). 
In Tier 2 (secondary prevention), students 
who are not responding to primary prevention 



engage in more intensive interventions in 
small groups. Functional Behavioral Assess- 
ments (FBA) may be conducted to better 
understand students’ needs and ways in 
which teachers can address these needs. In 
Tier 3 (tertiary prevention), individualized 
supports are provided to students after Tier 2 
supports are found to be insufficient (Burns et 
al., 2007). 

Johnson, Mellard, Fuchs, and McKnight 
(2006) describe the first tier of service as 
being particularly important because it “rep- 
resents the first ‘gate’ in a system designed to 
better accommodate the diverse learning 
needs of all students. . . [it] provides the foun- 
dation for instruction upon which all supple- 
mentary interventions (e.g., Tier 2 and 
beyond, special education) are formulated in 
a system of responsiveness to intervention” 
(Johnson, Mellard, Fuchs, & McKnight, p. 
3.5). It is within this tier that high-quality 
instruction and monitoring helps to shed light 
on the students who may need additional sup- 
port and services (e.g., small-group or indi- 
vidualized instruction that is more intense/ 
frequent). 

From the statewide RTI survey administered 
by CEEP, it was determined that there are a 
vast number of interventions being used by 
schools and corporations. Ninety respondents 
to the survey (12.8%) stated that they were 
fully implementing RTI (level 3), and among 
those respondents, 103 disparate intervention 
programs are reportedly being used in their 
schools. The top ten programs that are used in 
schools where RTI is being fully imple- 
mented include: My Sidewalks (Scott Fores- 
man), Read Naturally, SR A Corrective 
Reading, Voyager, Lindamood Bell: LiPS, 
Read 180, Reading Recovery, materials from 
the Florida Reading Center, Headsprout, and 
Accelerated Math. 

Among the 14 survey respondents (2%) who 
stated they were at the level of sustained prac- 
tice of RTI implementation (level 4), 16 dif- 
ferent intervention programs are reportedly 
being used in their schools. The top two pro- 
grams used are: My Sidewalks (Scott Fores- 
man) and Voyager. It should be noted that the 
interventions being used among the survey 
respondents varied greatly, and the overlap 
among the reported interventions is minimal. 
For example, the most widely used interven- 
tion among schools that are reported as fully 
implementing RTI is My Sidewalks (Scott 
Foresman), however only a total of eight 
respondents (4%) stated that this program is 
used at their school, and only two respon- 
dents (11.1%) reported using each of the level 
4 programs stated. 



Training and Professional 
Development Issues 

Shapiro (2008) states that as part of profes- 
sional development, it is necessary for teach- 
ers to be trained well and to adhere to the 
specifics of instructional programs. If this 
does not occur, it is virtually impossible to 
determine whether a program is failing due to 
the way in which the instructional strategy or 
intervention is being implemented, or 
because the students are not responding to 
instruction that should be effective. In addi- 
tion, professional development should 
accommodate the needs of both teachers just 
initiating tiered instruction, as well as teach- 
ers who have some experience with it. Hav- 
ing a more veteran teacher mentor a 
newcomer on the tiered instructional process 
can allow professional development to cater 
to the needs of both new and veteran teachers, 
as well as, facilitate understanding and imple- 
mentation. Further, continuous professional 
development can help teachers and schools 
keep abreast of advances in the current 
research and literature. Shapiro continues to 
drive his point home by stating that if the Tier 
1 core instructional program is implemented 
with high fidelity by well-trained teachers the 
expectation is that most students receiving 
this instruction will show proficiency in their 
assessment outcomes. Here, Shapiro brings 
to light an important point — fidelity of imple- 
mentation is important to ensure that student 
outcome data are accurate measures of stu- 
dent proficiency. 

Fixen (2008) agrees that building compe- 
tence through selection, training, coaching, 
and performance assessment is vital in 
accomplishing change as part of professional 
development. He adds that professional 
development should involve sharing infor- 
mation about recent development in the field, 
learning about innovations, and working on 
two-way communication (which is part of 
preparing for change). In his model it is 
important that training is done with trainers 
who know the innovation well. Good profes- 
sional development includes a precise 
description of the intervention, methods, 
underlying philosophy and values, and the 
data that supports its use. It should include 
demonstrations and examples of the interven- 
tion, have pre- and post-tests of knowledge 
and skills, and be revised often to meet the 
needs of coaches and staff. 

From the CEEP RTI Implementation Survey, 
out of the 7 10 respondents who answered that 
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their district or school is in the process of 
adopting or implementing the RTI frame- 
work, most respondents (74.5%) agreed that 
their school district or school has provided 
them with general professional development 
activities on RTI that have supported capacity 
building. Approximately 62% of respondents 
agreed with the comment that ongoing pro- 
fessional development is needed to sustain 
the implementation of the RTI framework in 
their school district and/or school. In all, 43% 
of respondents answered that substantial pro- 
fessional development is needed to develop a 
deeper understanding and capacity to imple- 
ment the RTI framework. However, 42.7% of 
respondents stated they have received profes- 
sional development activities that have sup- 
ported change in the curriculum and 
instruction to focus on evidence-based prac- 
tices. Only one third of the respondents 
agreed with the notion that their professional 
development activities have provided suffi- 
cient support to administer universal screen- 
ing and progress monitoring assessments. 
Lastly, 23.8% of respondents stated that pro- 
fessional development activities have pro- 
vided sufficient training for data analysis and 
data-driven decision making (see Table 1 
below). 

In addition, 702 survey respondents answered 
how many professional development activi- 
ties and training sessions on RTI they have 
participated in during this past school year. A 
plurality of 45.2% reported that they attended 
or plan to attend one to two activities or ses- 
sions during the 2008-09 school year. A total 
of 80 participants (11.4%) stated that they 
will have participated in zero professional 
development activities during the school year 
(see Table 2 below). 



Implementation with Fidelity 

Although the importance of the fidelity with 
which RTI is implemented was discussed in 
the first special report, it is worth restating in 
this second report. With high fidelity, we 
assume that the integrity of screening and 
progress-monitoring procedures is adhered 
to. In addition, it is critical that one be able to 
report the fidelity with which an academic or 
behavioral intervention was implemented so 
that any significant gains in student achieve- 
ment can be accurately attributed to the inter- 
vention, and so that the intervention can be 
replicated in other schools and districts. 
Many studies which have examined the inte- 
gral role that fidelity of implementation has 
on the effectiveness of intervention programs 
for students with learning disabilities include 



three key factors: fidelity of implementation 
of the process (at the school level), how 
empirically- supported the specific interven- 
tion was, and the teacher’s fidelity of inter- 
vention implementation (Johnson et al., 
2006). Further, Fixen (2008) states that 
because implementation efforts can take 
years to show up in the school- wide benefits 
for students, immediate measures must be in 
place to determine whether implementation 
will “pay off’ in the future. Some of these 
immediate measures include: pre-post tests of 
teacher training (i.e., good post-test scores 
should highly correlate with later teacher per- 
formance assessments), coaching feedback 
(i.e., good scores for a coach should highly 
correlate with later teacher performance 
assessments), and performance assessment 
information (i.e., good performance assess- 
ment measures should highly correlate with 



later student outcomes). The state guidance 
document (IDOE, 2009) also addresses this 
issue of implementation fidelity; the docu- 
ment highlights some key components that 
lead to RTI fidelity in general education and 
within interventions and extensions. These 
components include: 

• Systematic curriculum 

• Effective instruction 

• Direct instruction 

• Specified instructional materials 

• Checklist of key instructional components 

• CBM assessments 

• Videos and/or observations of classroom 
instruction 

• Data (results) graphed against goals 

• Student progress monitored monthly 

• Decisions regarding curriculum and 
instruction based on data 



TABLE 1 . CEEP Survey Respondents' Description of Professional Development Activities 





Number of 
Responses 


Percentage 

of 

Responses 


Rank 


General RTI information 


529 


74.5% 


1 


Support change in curriculum/instruction 


303 


42.7% 


4 


Sufficient support to administer universal 
screening/progress monitoring 


234 


33.0% 


5 


Sufficient training for data-driven decision 
making 


169 


23.8% 


6 


Need for more PD for understanding RTI 
implementation 


306 


43.1% 


3 


Need for ongoing PD to sustain RTI imple- 
mentation 


443 


62.4% 


2 


TOTAL 


1984 







Note: In addition, 702 survey respondents answered how many professional development 
activities and training sessions on RTI they have participated in during this past school year. Of 
those 702 respondents, most (45.2%) reported that they attended or plan to attend one to two 
activities or sessions during the 2008-09 school year. A total of 80 participants (1 1 .4%) stated that 
they will have participated in zero professional development activities during the school year. 



TABLE 2. CEEP Survey Respondents' Frequency of Participation in Professional 
Development Opportunities During the 2008-09 School Year 





Number of 
Responses 


Percentage of 
Responses 


Rank 


None 


80 


11.4% 


4 


1-2 


317 


45.2% 


1 


3-5 


224 


31.9% 


2 


6 or more 


81 


11.5% 


3 


TOTAL 


702 


100 
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The guidance document also includes sample 
fidelity checklists for use at the district, build- 
ing, and classroom levels that may be 
reprinted or adjusted as necessary (IDOE, 
2009). 

Johnson et al. (2006) have conceptualized the 
following approach to ensuring fidelity of 
implementation, which consists of three com- 
ponents. The first component, method, refers 
to the tools that provide different types of 
information. Frequency relates to how often 
checks are conducted, depending on the situ- 
ation. The third indicator of fidelity of imple- 
mentation is support systems, which relate to 
the feedback and opportunities for profes- 
sional development for staff needed to imple- 
ment a process with fidelity. 

In Tiers 2 and above there are two major cat- 
egories of implementation fidelity that fall 
under the dimension of method-direct and 
indirect assessment. Direct assessment 
involves a qualified staff member examining 
the intervention and recording the occurrence 
(count) of each intervention component that 
is listed on a checklist. This is done to deter- 
mine the correctly implemented percentage 
and to ensure that teachers are properly 
trained. Indirect assessment involves such 
measures as permanent products (such as stu- 
dent work samples), self-reports, interviews 
and rating scales. Of the two types of assess- 
ments, direct (and frequent) assessment is 
viewed as best practice. With frequency 
checks, teachers are observed (depending on 
their level of teaching experience) to ensure 
the fidelity of implementation. In addition, 
teachers are monitored on support requests, 
overall student performance in the classroom, 
and the degree to which special education 
referrals decrease or do not decrease. The 
third component, support systems, may be 
required to remedy areas where there are def- 
icits by providing professional development 
or allocating resources to help teachers. 
Reschly and Gresham (2006) state that in 
order to help ensure fidelity operations, tech- 
niques, and components of the intervention 
should be definitively described, responsibil- 
ities of those involved defined, and account- 
ability measures/sanctions for non- 
compliance created. 

There is a reinforcing cycle relating high 
fidelity to student outcomes; if there is a high 
level of fidelity in implementing the curricu- 
lum and appropriate instruction, then student 
outcomes are better, which lead to better 
credibility and reliability of the curriculum 
and instruction. Johnson et al. (2006) state 
this in turn “naturally” leads to more highly 
motivated staff, who will continue to imple- 



ment the curriculum and instructional prac- 
tices with high fidelity to maintain the 
credibility of the curriculum and instruction. 

An example of a school district that has been 
successful in their implementation of RTI is 
Hesperia Unified School District in Califor- 
nia (California Department of Education, 
2005). Approximately 10 years ago, the dis- 
trict started to realize that special education 
(SPED) was an expensive service delivery 
model that was inefficient, ineffective, and 
did not provide improved academic achieve- 
ment in their students. The district started 
using more effective and efficient means for 
meeting the needs of its students in the form 
of an RTI framework. They turned to RTI 
because they believed students should be 
given the opportunity to be served before 
being formally identified or labeled. The 
gains have been significant; since the start of 
the RTI approach, the school district has had 
a 64% decrease in the number of students 
who qualify for SPED. In addition, the aca- 
demic performance index base scores, which 
reflect a school’s or LEA’s performance level 
in the state and is used to measure academic 
growth, have increased 43 points from 2002 
to 2005 (see Figure 2). 



ASSESSMENT AND PROGRESS 
MONITORING 



What is Assessment and 
Progress Monitoring, and Why 
Do We Monitor Progress? 

Ongoing student assessment is important in 
the RTI framework and includes both the ini- 
tial universal screening of students to deter- 
mine what type of services students should 
receive (Tier 1, 2, 3), as well as progress mon- 
itoring, or measuring individual progress 
“toward important educational outcomes” 
(Deno, n.d.). Students are assessed on spe- 
cific skills that are highlighted in state and 
local academic standards. The number of per- 
formance samples that are collected range 
from once per week (i.e., progress monitor- 
ing, depending on the intensity of the inter- 
vention) to three times per year (i.e., 
universal screening). These assessments were 
designed to be administered efficiently and 
repeatedly over short periods of time with 
each probe typically taking between 1 to 3 
minutes, depending on the general outcome 
being measured (Deno, n.d.). Appropriate 
progress monitoring assessments are charac- 
terized by key traits such as having multiple 
forms that can be used over time, providing 
information that can be used in the develop- 
ment of instructional strategies, and address- 
ing the area of need for each student. Progress 
monitoring tools are scientifically valid and 
efficient for determining whether instruc- 
tional modifications are needed and provid- 



FIGURE 2. Academic Performance Index Scores for Hesperia Unified School District (CA) 




Source: California Department of Education (2005). Hesperia Unified School District Retrieved Decem- 
ber 2, 2008, from: http://www.cde.ca.gov/ta/lp/vl/documents/prof06hesperiausd.doc. 
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ing important information for future student 
placement decisions (Hosp, 2007). 

In addition to the general screening measures, 
curriculum-based measurements (CBM) are 
used as well to assess the various skills cov- 
ered in the curriculum. CBM is one of the 
most commonly used tools to monitor 
progress, and refers to brief, repeated sam- 
pling of student performance on a single core 
task from the curriculum. At Tier 2 and 
beyond, the purpose of progress monitoring 
is mainly to determine (using a set of rules) 
whether the intervention used with a particu- 
lar student was successful in helping him/her 
learn at an appropriate rate. CBM uses stan- 
dardized procedures to assess students’ per- 
formance on their long-term goals. Most 
forms of classroom assessment are mastery 
measurement, which assess (via teacher- 
made tests or tests in the curriculum) specific 
skills to be taught in class; thus their validity 
and reliability are unknown. Further, the 
retention and generalization of skills are not 
usually measured. Students progress at differ- 
ent levels and with a variety of skills making 
monitoring the individual development of 
those skills difficult. CBM, however, is typi- 
cally not a mastery measurement — it is usu- 
ally a general outcome measure, which tests 
general domains, thus allowing teachers to 
track long-term goals (Hosp, 2007). Over the 
last 20 years, CBM has shown to be both a 
reliable and valid indicator of core reading, 
writing, and arithmetic skills. These psycho- 
metric properties are desirable characteristics 
when progress monitoring (Deno, 2003). 



What is the Function Of 
Universal Screening? 

Student progress is important to monitor 
because the data is needed to make important 
educational decisions. School-wide screen- 
ing or universal screening is “an important 
first step in any prevention approach ... to 
accurately identify those who are at risk for 
learning (and behavioral) difficulties. Screen- 
ing is a type of assessment that is character- 
ized by providing quick, low-cost, repeatable 
testing of age-appropriate critical skills (e.g., 
reading a list of high frequency words) or 
behaviors (e.g., aggression). The primary 
objective in a screening measure is to deter- 
mine whether or not the student should be 
judged as ‘at risk’ ” (Johnson et al., 2006, p. 
1.2). Useful screening measures should be 
accurate in their ability to identify students 
whose performance on the measure calls for a 
more in-depth analysis. The accuracy is 
determined in part by the cut score, which is 



the score that represents the dividing line 
between students who may be, or are not, at 
risk. In addition to accuracy, screening mea- 
sures should also be efficient, that is, be eas- 
ily and quickly administered by teachers. The 
authors stress that screening is “not a one- 
time process but an iterative system during 
the school year and across grade levels” 
(Johnson, 2006). The RTI modules developed 
at IRIS Center at Vanderbilt University sug- 
gest that with universal screening, no matter 
the type of measure used, it is important that 
teams rank-order students in a classroom or 
grade according to scores (highest to lowest) 
to identify the students who are performing 
the lowest in the classroom or grade level. 
Depending on the availability of resources, 
teachers and other involved school personnel/ 
team members select either a predetermined 
number of students from the lowest-ranked 
group (e.g., the bottom eight students) or a 
predetermined set percentage of the lowest 
performing students (e.g., the bottom 20% of 
students) (IRIS Center, n.d.). 

One example of a tool that is used for univer- 
sal screening for behavioral problems in 
schools is the Systematic Screening for 
Behavioral Disorders (Walker & Severson, 
1992). The SSBD has three stages in which 
all students are systematically ranked accord- 
ing to internalizing or externalizing behav- 
ioral profiles by the classroom teacher (stage 
1), the top three students from both behav- 
ioral profiles are then further evaluated by the 
teacher using rating scales (stage 2), then 
finally another school professional uses 
structured observation and recording proce- 
dures to evaluate the students in both the 
classroom and playground settings. Students 
who exceed stage 3 cutoff scores are referred 
to child study teams (Walker et al., 1990). 



When Do We Monitor Student 
Progress? 

Progress monitoring, Johnson et al. (2006) 
state, can serve different functions at the var- 
ious tiers. With Tier 1, universal screening 
and progress monitoring are very similar. 
Screening of all students in the school is used 
to determine which students are not perform- 
ing at grade level (by comparing their perfor- 
mance relative to a norm-referenced 
benchmark). Once students have been 
screened, students who are considered “at 
risk” are progress monitored more frequently 
(i.e., multiple times between benchmark peri- 
ods). “At risk” is not a terminology that is 
used solely with students who are considered 
to be low performers; rather it is a term that 



may be applicable to any student, including 
high achievers who are not reaching their full 
potential (IDOE, 2009). 

Progress monitoring can be used to show 
individual student growth over time to deter- 
mine whether the student is progressing as 
expected in the general curriculum. The fol- 
lowing figure identifies some important fea- 
tures of universal screening that should be 
taken into consideration (see Figure 3). These 
characteristics include: making sure the aca- 
demic and behavioral objectives of the curric- 
ulum and assessment are aligned, evaluation 
of the universal screening tests for efficiency 
and adequacy, ensuring a means for data anal- 
ysis, and asking whether the screening data 
indicate a problem amongst a large group, 
small group, or individual students (Ikeda, 
Neessen, & Witt, 2008). 

Jenkins and Johnson (2008) discuss some key 
ideas regarding how to choose a procedure 
for universal screening. The research sup- 
ports the use of a screening battery, or multi- 
ple measures, for better classification of 
students. The screening for reading should 
include measures of both fluency as well as 
comprehension. In addition, research also 
supports the use of multiple screenings 
throughout the year, as this process helps to 
reduce the number of classification errors. 
Jenkins, Hudson, and Johnson (2007) defined 
some attributes of an ideal screening mecha- 
nism including strong criterion validity and 
screening/classification accuracy (looking at 
sensitivity/ “true positives” and specificity/ 
“true negatives” of the measure). Since hav- 
ing false negatives (i.e., not classifying a stu- 
dent as needing more intensive services when 
he/she needs it) is more detrimental than hav- 
ing false positives (i.e., classifying a student 
as needing more services when he/she 
doesn’t need it), screening tools should strive 
to correctly identify at least 90% of students 
who will show reading difficulties/failure in 
the future, and at least 80% of students who 
are not “at risk” (Jenkins & Johnson, 2008). 

For kindergarteners, Jenkins and Johnson 
(2008) suggest measures that test various 
combinations of letter naming fluency, letter 
sound identification, blending onset-rimes, 
phoneme segmentation, and sound repetition. 
For first graders, the measures that were 
highly sensitive and had good specificity were 
those that used various combinations of word 
identification fluency, letter naming fluency, 
letter sound identification, phoneme segmen- 
tation, vocabulary, and sound repetition. For 
students in second grade and above, the 
researchers suggested using measures that 
tested both oral reading fluency as well as 
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FIGURE 3. A Flowchart of Features Integral to Universal Screening 




Source: Ikeda, M.J., Neessen, E., & Witt, J.C. (2008). Best practices in universal screening. In A. Thomas 
& J. Grimes (Eds.), Best practices in school psychology V (pp.1 03-1 1 4). Bethesda, MD: National Associa- 
tion of School Psychologists. 



comprehension. They found that at these 
grade levels, most states administered stan- 
dardized tests (either district or statewide) 
annually and were able to identify at-risk stu- 
dents based on the results. The suggested mea- 
sures listed have been shown to be successful 
with predicting outcomes based on high spec- 
ificity and sensitivity rates. Local preferences 
determine which of these measures in each 
grade are utilized and at what times. 



How Do We Know Whether a 
Student is Progressing? 

Fuchs and Fuchs (2007) state in their manual 
that generally progress monitoring occurs fre- 
quently (weekly or biweekly), and that each 
student is given one probe of a curriculum 



based measurement, and then the alternate 
form of the same measurement (therefore, 
each student has two scores for one measure 
of CBM). However, for the CBM of oral read- 
ing fluency, three passages are typically 
administered to the child to maximize bene- 
fits and validity. The median score is plotted 
on the child’s graph. Suitable probes can be 
found from such websites as AIMSweb, 
DIBELS, EdCheckup, or the Peabody CBM. 
The next step is determining the grade level of 
passages to use with each student. Often 
teachers and administrators start with pas- 
sages at the student’s assigned grade level 
because they want to know how well students 
perform in their grade-level reading material. 
If a student cannot read the assigned passage 
with 90% accuracy or better, then his or her 
performance is monitored at each previous 
grade level of text until he/she can read with 



90% accuracy (e.g., a third grader may need 
to be monitored using second and then first 
grade passages if he/she cannot read third 
grade passages with 90% accuracy). An 
appropriate improvement goal is determined 
next. Jenkins, Hudson, and Lee (2007) sug- 
gest that generally, first graders show the 
most improvement with an increase of 1-3 
words read correct (WRC) per week. Second 
graders generally have an increase of 1-2 
WRC per week, and smaller improvements 
for those in later grades. Once the improve- 
ment goal is determined, an aimline is calcu- 
lated by multiplying the number of weeks of 
instruction by the rate of improvement, then 
adding the baseline median (the median score 
of a probe from the first administration) to 
show the desired progress rate over the course 
of instruction (Jenkins et al., 2007). Each time 
probes are given, the data points are plotted. 
Fuchs and Fuchs (2007) recommend using a 
cut-off point system to determine which stu- 
dents are progressing (in a 6-10 week period) 
in the general education curriculum versus 
those who are not. Some useful websites for 
progress monitoring include: http://www.stu- 
dentprogress.org/chart/chart.asp and http:// 
www. studentprogres s . org/library/ 
readingcbm_module/player.html, which pro- 
vide a chart of frequently used progress mon- 
itoring tools and a training module on reading 
CBM, respectively. 

After plotting data points, as Fuchs, Fuchs, 
Hintze, and Lembke (2007) note, a trend-line 
is determined to calculate the slope. Fuchs et 
al. (2007) present step-by-step instructions 
for creating a trend-line for monitoring stu- 
dent progress using the Tukey method (see 
Figure 4). 

After drawing the trend-line, Fuchs et al. 
(2007) suggest calculating the slope by using 
a numerical formula: (3rd median point- 1st 
median point)/ (# of data points - 1). This 
slope provides a quantifiable rate of progress. 
More specific ways to draw the trend line to 
which students' progress at each progress 
monitoring day should be compared, as well 
as how to calculate the slope of the trend line 
are discussed in the manual (Fuchs and 
Fuchs, 2007). 

There are some characteristics that define a 
good progress monitoring assessment 
(Batsche et al., 2005). First, it must assess the 
specific skills embodied in state and local 
academic standards and measure skills that 
have been demonstrated to indicate growth 
toward the instructional goal. While they 
should measure the general curriculum, the 
assessment must also be relevant to the devel- 
opment of instructional strategies and use of 
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appropriate curriculum that addresses the 
individual need of the student. They must 
also be sensitive to small increments of 
growth over time so that changes can be 
responded to quickly. Because these mea- 
sures will often be given by teachers they 
must be capable of being administered 
repeatedly (using multiple forms) and effi- 
ciently over short periods, and result in data 
that can be summarized in teacher-friendly 
data displays. Lastly, a good progress moni- 
toring assessment must also be comparable 
across students so that the student’s progress 
can be judged in comparison to their peers. 



State and Local Example of 
Progress Monitoring 

The schools in Jefferson County, TN have 
implemented an RTI framework consistent 
with IDEA 2004 and NCLB requirements 
(Jefferson County Schools, n.d.). Jefferson 
County Schools’ RTI approach has been 
approved by the state for their K-5 Literacy 
component, as outlined in their Student Inter- 
vention Team Manual. Within their RTI 
framework all students are first screened in 
Kindergarten and Grades 1-3 using the Think 
Link Benchmark Assessments (Discovery 
Education). Students whose Think Link 
scores fall in the lowest 10% in reading for 
each grade level are identified as at risk for 
academic failure. These students receive Tier 
1 interventions as well as the general educa- 
tion instruction. All students receive the evi- 



dence-based general education classroom 
instruction, which is an uninterrupted 90- 
minute reading block. Students who receive 
interventions in Tier 1 also receive an addi- 
tional 30 minutes, three times per week, of 
the general education instruction in small 
groups led by the classroom teacher (Scott 
Foresman Tier 1 interventions). The interven- 
tion is monitored weekly using the Think 
Link progress monitoring probes for fidelity 
and effectiveness by the Student Intervention 
Team. After about nine weeks of the interven- 
tion, the team reconvenes and meets with 
each student’s parents/guardians to review 
the student’s progress. If the student is pro- 
gressing but the growth rate is right around 
the 25 th percentile, the team and parents may 
decide to continue with Tier 1 intervention 
until adequate gains are made (i.e., the stu- 
dent is no longer in the lowest 10% of the 
grade in reading). However, if the student is 
not showing progress (i.e., the student 
remains in the lowest 10% and the growth 
rate is still below the 25 th percentile), they 
may decide to start Tier 2 interventions. 

Tier 2 interventions consist of students con- 
tinuing to receive the additional 30 minutes 
of the general education instruction led by the 
classroom teacher three times a week (Tier 1 
intervention), with a second unit of 30 min- 
utes of small group, more specific instruction 
led by a literacy coach/trained personnel at 
least twice a week. Teachers continue to mon- 
itor student progress on a weekly basis, and 
after nine weeks, the team meets once again 
with parents/guardians to discuss progress. If 



FIGURE 4. Creating a Trend-line to Calculate Slope 
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Step 1: Divide the data points into 
three equal sections by drawing two 
vertical lines. (If the points divide 
unevenly, group them approximately.) 

Step 2: In the first and third sections, 
find the median data point and 
median instructional week. Locate the 
place on the graph where the two 
values intersect and mark with an "X." 

Step 3: Draw a line through the two 
Xs, extending to the margins of the 
graph. This represents the trend -line 
or line of improvement. 
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Weeks of Primary Prevention 



Source: Fuchs, Fuchs, Hintze, and Lembke (2007, July). Using curriculum-based measurement to deter- 
mine response to intervention. Paper presented at the 2007 Summer Institute on Student Progress Mon- 
itoring, Nashville, TN. Retrieved December 1 7, 2008, from: http://www.studentprogress.org/ 
summer_institute/2007/RTI/ProgressMonitoring-RTI2007.pdf. 



the student makes adequate gains (by pro- 
gressing and/or no longer being in the bottom 
10%) he/she may receive solely Tier 1 inter- 
ventions or discontinue any supplemental 
interventions. If the student does not progress 
(i.e., the student remains in the lowest 10% 
and the growth rate is below the 25 th percen- 
tile, or the student’s charted data indicate a 
flat line or a regression after at least 18 ses- 
sions of the intervention), he/she may be 
moved into Tier 3 interventions, where Tier 1 
interventions are still in place with additional 
classroom interventions. Tiers 2 and 3 can be 
combined for an intensive intervention in 
Tier 3 interventions, or Tier 3 interventions 
can increase the duration, frequency, or type 
of intervention. The teacher monitors student 
progress on a weekly basis, and after four 
weeks, the team meets to discuss the student’s 
progress. If the student is not making gains at 
this time (i.e., the student remains in the low- 
est 10% and the growth rate is below the 25 th 
percentile), he/she will be referred for an 
evaluation to be considered eligible for spe- 
cial education services (Jefferson County 
Schools, n.d.). 



DATA-BASED DECISION MAKING 



What is Data-based Decision 
Making and its Relationship to 
Progress Monitoring? 

Data-based decision making is a process that 
occurs as a result of progress monitoring, 
where school-wide, multidisciplinary teams 
that include both general and special educa- 
tion teachers review assessment data in mak- 
ing decisions about placement in and the 
movement between tiers of service delivery 
(Martinez & Nellis, 2008). These teams use a 
problem-solving process to determine what 
type of service each student should receive. 
These teams are an important part of creating 
curricular improvements, designing interven- 
tions, and deciding which students will bene- 
fit from additional tiered instruction 
(Kovaleski et al., 2008). 



Using Problem-Solving Process 
for Data-based Decision 
Making 

There are many options for how to measure 
whether a student is “responding” to the 
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intervention. Fuchs and Fuchs (2006) address 
two areas of the assessment process that need 
to be specified: a method to measure stu- 
dents’ responsiveness to the instruction, and 
once that has been conceptualized, a criterion 
for defining nonresponsiveness. For example, 
one can use a more standard treatment proto- 
col. Methods of the standard approach can be 
delivered in small groups or individually to 
students, but using a fixed duration- type 
“trial.” If students are unresponsive to the 
trial intervention, they are provided with fur- 
ther support at a higher tier (i.e., 2 or 3). A 
standard treatment protocol applies interven- 
tions in a consistent manner across all stu- 
dents struggling in the same area. It relies on 
preconceived assumptions about how chil- 
dren learn. The problem-solving method, 
however, allows for more individualized 
flexibility among students. In the problem- 
solving model, skill deficits are considered 
on an individual basis. At each level or tier 
teams define and determine the magnitude of 
the student’s problem, analyze (and hypothe- 
size) the causes of it, design a goal-directed 
intervention based on hypotheses (which they 
conduct with fidelity), monitor the progress, 
modify the intervention on an as -needed basis 
after examining student responsiveness, and 
evaluate the intervention’s effectiveness and 
plan future actions (Fuchs & Fuchs, 2006). A 
visual representation of such a problem-solv- 
ing model is displayed below (Figure 5). 

An example of a framework of RTI that uti- 
lizes a problem-solving model comes from 
Minneapolis, MN. Marston, Muyskens, Lau, 
and Canter (2003) describe the Minneapolis 
Public Schools’ problem-solving model, stat- 
ing that their framework uses a sequence of 
problem-solving steps for identifying and sup- 
porting students who encounter academic dif- 
ficulties. Their model consists of four steps: 1) 
describe the student’s problem in detail (using 
valid and reliable measures to assess student’s 
skills); 2) develop and implement strategies 
for instructional intervention (with fidelity to 
ensure accurate decision-making); 3) progress 
monitor and evaluate the effectiveness of 
instruction using CBM probes; and 4) con- 
tinue the cycle on an as-needed basis. Since 
the problem-solving model is based on a 
“teach-test-teach-test” model of service deliv- 
ery where students’ response to interventions 
drives decision making the model repeats as 
long as warranted. 

For practitioners using RTI, a problem-solv- 
ing approach to intervention is preferable, 
specifically one utilizing CBM (Fuchs & 
Fuchs, 2006; Martinez & Nellis, 2008). As 
previously discussed, teachers can use stu- 
dents’ data and plot them on graphs to com- 



pare the slopes of the graphs to expected rates 
of progress based on either local or national 
norms (Martinez & Nellis, 2008). For exam- 
ple, scores that increase with time indicate the 
student is responding to the instructional pro- 
gram (see Figure 6). 

On the other hand, flat or decreasing scores 
over time indicate the student is not respond- 
ing to the intervention (see Figure 7), and a 
change to the student’s instruction is neces- 
sary (Fuchs & Fuchs, 2007). 

Iowa’s Heartland Area Education Agency 
(AEA) has adopted a problem-solving model 
over a standard treatment protocol. Rather 
than assuming one intervention will work for 
many students (and placing them in a more 
intensive tier when students do not show 
progress), a problem-solving model requires 
staff to continually and directly monitor stu- 
dents’ progress and adjust the interventions 
based on their performance on CBMs (Tilly, 
2003). Other ways in which schools have 
determined criterion for whether students 
have responded to interventions include a 
“dual discrepant” criterion, which is similar 
to the aforementioned method of determining 
the rate of students’ growth over time, and a 
“3-point decision rule.” The “dual discrep- 
ant” criterion not only uses students’ rate of 
growth, but also their previously determined 
outcome level on each measure. Thus, stu- 
dents who progress at an acceptable rate 
AND who reach a predetermined criterion 
have responded to the intervention (Fuchs, 
Fuchs, & Compton, 2004). However, the 



most commonly used criterion is the “3 -point 
decision rule,” where an individual goal is set 
for each student. The student’s data are plot- 
ted on a graph and an aimline (the line that 
depicts what the expected rate of progress/ 
growth from the student’s baseline to the 
goal) is drawn. An instruction decision is 
made based on whether the student’s last 
three data points are above the aimline 
(responding) or below the line (not respond- 
ing) (Barnes & Harlacher, 2008). 



Example of Data-based 
Decision Making 

One example of using data to make decisions 
comes from Tualatin Elementary School in 
Tualatin, OR, where all students are screened 
for academic and behavioral instructional 
support needs in the fall, winter, and spring. 
Examples of data collected at these times 
include DIB ELS, Oregon State Assessments, 
and attendance, behavior, and counseling 
records. Tualatin’s Effective Behavior and 
Instructional Support (EDIS) team meets 
weekly to monitor all students receiving 
small group or individual interventions. 
Twice a month, EBIS meets to plan and 
implement school wide supports. In addition, 
content teams meet monthly to recommend 
improvements to curriculum and instruction. 
The school utilizes five different decision 
rules, to aid in making judgments regarding 
movement between tiers and to help evaluate 



FIGURE 5. A Problem-solving Method 
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Source: Indiana Department of Education (2009). Indiana’s Vision of Response to Intervention: 
Using Response to Intervention (RTI) for Indiana’s Students. 
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FIGURE 6. Graph of Student Responding to Intervention 
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Retrieved from: Johnson, E., Mellard, D.F., Fuchs, D., & McKnight, M.A. (2006). Responsiveness to 
intervention (RTI): How to do it. Lawrence, KS: National Research Center on Learning Disabilities. 



FIGURE 7. Graph of Student Not Responding to Intervention 
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Retrieved from: Johnson, E., Mellard, D.F., Fuchs, D., & McKnight, M.A. (2006). Responsiveness to 
intervention (RTI): Howto do it. Lawrence, KS: National Research Center on Learning Disabilities. 



the curriculum. These rules include: the 80% 
decision rule, the 20% decision rule, the 
Change Small Group or Individual Interven- 
tion rule, Individualize Instruction rule, and 
the Refer for Special Education Evaluation 
rule (National Research Center on Learning 
Disabilities, 2006). The 80% rule states that 
school staff must review the core program(s) 
if less than 80% of students are meeting 
benchmarks. The 20% rule refers to students 
who are below the 20 th percentile in aca- 
demic skills or those students who have 
“chronic behavior needs,” that is five 
absences or more than three counseling or 
discipline referrals in a 30-day period and are 
placed in small-group instruction. The 
Change Small Group or Individual Interven- 



tion rule states that the staff changes the inter- 
vention for students whose progress data line 
is below that of the aim line on three consec- 
utive days, or when six data points produce a 
trend line that decreases or is flat. The Indi- 
vidualize Instruction rule states that individ- 
ual instruction begins when a student does 
not progress after two consecutive small- 
group interventions. Lastly, the Refer for 
Special Education rule states that students are 
referred for evaluation when they do not 
progress after two consecutive individual 
interventions. 



FUTURE DIRECTIONS 

As stated in the first report, the Center for 
Evaluation and Education Policy (CEEP) is 
working with the Department of Education to 
evaluate data collected from the 42 RTI 
Academy schools and other schools imple- 
menting RTI around the state. Currently, data 
has been collected from surveys that have 
been distributed to school personnel across 
Indiana, and is summarized in this report. 
Additionally, twelve site visits (six at RTI 
Academy schools and six at non-RTI Acad- 
emy schools) have been conducted across the 
state. These schools are reflective of Indiana's 
student population based on prior ISTEP+ 
performance, free and reduced-price meal 
program eligibility data, geographic balance, 
and locale type (urban, suburban, and rural). 
Visits occurred between May 7 and June 9, 
2009. The objective of the site visits was to 
examine local implementation and success 
with scientific, research-based interventions. 
In particular, we wished to explore how the 
core components of RTI are being imple- 
mented in classrooms and throughout the 
school buildings, identify what research- 
based interventions are being used in the 
schools and to what extent they appear to be 
working, and examine the implementation 
barriers and ongoing challenges that schools 
face. More information about the findings 
from the site visits will be forthcoming in 
future reports. 

The current report is the second of three spe- 
cial reports regarding the effectiveness of RTI 
in the state of Indiana. In the final report, we 
will discuss in more detail the last three core 
components that the Indiana Department of 
Education has determined as being integral to 
RTI: Leadership; Family, School, and Com- 
munity Partnerships; and Cultural Respon- 
sivity. 
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WEB RESOURCES 

Academic Well-Check Program (AWCP) 

http://www.awcpindiana.org/ 

AIMSweb: Progress Monitoring and RTI System 

www.aimsweb.com 

Curriculum-Based Measurement Warehouse 

http://www.interventioncentral.org/htmdocs/interventions/cbmwarehouse.php 

DIBELS Data System: Dynamic Indicators of Basic Early Literacy Skills 

http://dibels.uoregon.edu 

IDEA and Rtl 

http://idea.ed.gOv/explore/view/p/%2Croot%2Cdynamic%2CQaCorner%2C8%2C 

National Center on Student Progress Monitoring 

http://www.studentprogress.org 

Rtl Action Network: Ongoing Student Assessment 

http://www.rtinetwork.org/Essential/Assessment 

Tools for Teachers in Implementing RTI 

http://www.specialconnections.ku.edu/cgi-bin/cgiwrap/specconn/ 

main.php?cat=assessment&section=teachertools 

Using CBM for Progress Monitoring in Reading 

http://www.studentprogress.org/library/readingcbm_module/player.html 

Vanderbilt University IRIS Center 

http://iris.peabody.vanderbilt.edu/rti01_overview/chalcycle.htm 

What Works Clearinghouse 

http://www.ies.ed.gov/ncee/wwc/ 
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